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A system and method for imaging reflective surfaces are disclosed wherein a diffused light source having a predetermined frequency 
range and in a predetermined pattern is directed toward the reflective surface. The light reflecting off the surface passes through a filter 
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System and Method for Capturing a Range Image of a Reflective Surface 
Field of the Invention 

The invention relates to three dimensional (3-D) computer vision and more 
particularly to three dimensional imaging of objects having reflective surfaces. 

S Background of the Invention 

Human vision relies on experience and stereoscopic vision to determine ranges of 
objects. Each of two eyes capture an image from locations offset by a predetermined 
distance, and the brain determines a range to at least an object within a field of view. 
When peering into a mirror, a person sees images within the mirror of objects that are 
1 0 outside the mirror. Stereoscopic vision establishes a distance to the images that is 

substantially the distance light travels from the objects to the person's eyes. As such, the 
English language has an expression "tricks with mirrors" wherein mirrors are used to alter 
a physical space. For example, placing mirrored tile on a wall in a small room, makes the 
room appear much larger. 

1 5 Stereoscopic systems similar to human vision have been proposed for computer 

vision with applications in measurement, testing, robotics, modeling, manufacturing, 
navigation, and so forth. It is the very breadth of applications for computer vision that has 
made them popular both in terms of research and adoption. 

Two popular techniques currently in use for optical ranging of a target surface are 
20 known, respectively, as the standard optical triangulation system and the Biris (bi-iris) 

system, the latter employing an apertured mask in a converging lens system of an imaging 
device having a position sensitive detector, e.g. a CCD camera. 

These systems are described and compared in a paper entided "Practical 
Considerations for a Design of Industrial Systems, SPIE Vol. 959, 1988, pp 225-246 by 
25 F. Blais et. al., and also in. "Optical Range Image Acquisition for the Navigation of a 
Mobil Robot, " published in the proceedings of the 1991 IEEE International Conference 
on Robotics and Automation, Sacramento, Califomia^ April 9-11, 1991 by F. Blais et. al. 

1 
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A fiirther article of note is "Active, Optical Range Image Sensors." by Paul J. Besl, 
Machine Vision and Applications (1988) 1:127-152. All these documents are hereby 
incorporated herein by reference. 

A sample machine vision system is disclosed in U.S. Patent number 5, 270, 795 
entitled Validation of Optical Ranging of a Target Surface in a Cluttered Environment, in 
the name of F. Blais. The system comprises a coUimated laser light source and an image 
capture means for capturing light diffused by opaque surfaces. It merges the features of 
standard optical triangulation systems and those of Biris systems. The system uses a laser 
light source and a detector having two irises distanced apart. Light from the laser diffused 
from opaque surfaces is detected at the detector through each of the two irises. The 
resulting images are conflated to determine range. Unfortunately, when surfaces are 
reflective or transparent, collimated light sources are often reflected as coUimated beams 
missing the image capture means. As such, many range sensing means relying on optical 
range sensing are limited to substantially opaque surfaces. The content of U.S. Patent 
number 5, 270, 795 to F. Blais is hereby incorporated herein by reference. 

In U.S. Patent 4,645,347 titled Two Dimensional Imaging Device in the name of Rioux, 
a mask aperture having a plurality of apertures therein is described for use in imaging. 
Such a mask is cost effective in reducing a number of required detectors in an imaging 
system and for reducing effects caused by vibration. 

Object of the Invention 

In an attempt to overcome these and other limitations of the prior art, it is an 
object of the present invention to provide a system and a method for ranging reflective 
surfaces and for determining a geometry for said surfaces. 

Summary of the Invention 

In accordance with the invemion there is provided a method of measuring a distance from 
a first location to a reflective surface. The method comprises the steps of: 
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directing diffused light toward the reflective surface forming an image therein; 

using a range imaging means having a detector, measuring a distance from the detector to 
the image; and 

determining the distance to the reflective surface based on a known relationship between 
5 the location of a diffused light source, the location of the detector and the distance from 
the detector to the image. 

In accordance with the invention there is provided a method of measuring a distance to a 
reflective surface comprising the steps of: 

projecting toward the reflective surface a pattern of diffused light forming an object; 

10 using an imaging means comprising a detector, said detector having a known spatial 

relation to the object, receiving some of the projected light reflected off of the reflective 
surface and forming an image of the object; 

using a processing means, determining a range to an image of the object; and 

using the processing means, determining a distance to the reflective surface based on the 
1 5 known spatial relation and the image range. 

In accordance with another aspect of the invention there is provided an imaging system 
comprising 

a diffused light source for directing diffused light toward a surface and for forming at 
least an image therein; 

20 an imaging means comprising at least a detector for receiving diffused light reflected from 
the surface and having a predetermined spatial relation with the diffused light source; and 

image processing means for determining a distance from the system to an image 
of the at least an image and for determining a distance from the system to at least a 
location on the surface from which diffused light is reflected. 
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An advantage of the present invention is the ability to model reflective surfaces 
using an optical range measurement device. 

Brief Description of the Drawings 

Exemplary embodiments of the invention will now be described in conjunction 
5 with the following drawings, in which: 

Fig. 1 is a simplified diagram of a prior art imaging device imaging a reflective surface; 
Fig. 2 is a simplified diagram of a prior art imaging device failing to image a reflective 
surface; 

Fig. 3 is a simplified diagram of a device according to the present invention imaging a 
1 0 reflective surface; 

Fig. 4 is a simplified diagram of a device according to the present invention imaging a 

planar reflective surface and indicating the effect of a field of vision upon a detector; 

Fig. 5 is a simplified diagram of a device according to the present invention incorporating 

two detectors and a single diffused light source; 
1 5 Fig. 6 is a simplified diagram of a device according to the present invention incorporating 

two detectors and two diffused light sources; 

Fig. 7 is a simplified diagram of a device according to the present invention incorporating 
three detectors and a diffused light source; 

Fig. 8 is a simplified diagram of a device according to the present invention incorporating 
20 two detectors and two diffused light sources; 

Fig. 9 is a simplified diagram of a device according to the present invention incorporating 
a plurality of detectors and a single diffused light source and imaging a transparent 
substrate having a predetermined non-zero thickness; 

Fig. 10 is a simplified diagram of a device according to the present invention imaging a 
25 reflective surface that is non-planar; 

Fig. 1 1 is a diagram showing a triangulation method of determining image range; 

Fig, 12 is a simplified diagram of a Biris range system employing a single Biris detector 

and four diffused light sources; and 
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Fig. 13 is a flow diagram of a method of detennining distance and reflective surface 
geometry according to the present invention. 

Detailed Description of the Invention 

Reflective surfaces reflect incident light at an angle equal to the angle of incidence. In 
5 Fig. 1 is shown a reflective surface 5 with an object in the form of a collimated laser light 
source 2 having an iris with a predetermined shape 3, and a detector 9, on a first side 
thereof and according to the prior art. On a second side thereof is an image 7 of the object. 
Once a range for a reflective surface 5 has been determined, a detector 9 and a collimated 
laser light source can be aligned (as shown in Fig. 1) to allow for the detector to capture a 
10 reflected collimated beam 4c. Unfortunately, absent knowledge of range, orientadon, and 
characteristics such as shape, alignment is not possible and detecting the collimated 
reflected beam is a matter of chance. 

Referring to Fig. 2, a reflective surface 5 in the form of a polished mirror is shown 
having an object, a collimated laser light source 2 having an iris with a predetermined 

1 5 shape 3, and detector 9 according to the prior art on a first side thereof and having an 
image on a second side thereof Paths of light are shown for light from the collimated 
laser light source 2. As can be seen, light reflected by the reflective surface 5 misses the 
detector 9 and therefore is not used in determining a range for the surface 5. Alternatively, 
when light is diffused at the object, it is imaged by the detector 9 and is used for 

20 determining a range. Resulting range images treat reflective surfaces and transparent 
surfaces as holes or worse yet, inconsistently treat them as either holes or, when 
alignment happens to be appropriate, as surfaces. Further, the number of diffused and 
reflected signals reaching a detector leads to inconsistent range detection. 

Referring to Fig. 3, an embodiment of the present invention is shown opposite a 
25 reflective surface 5 in the form of a highly polished mirror. A laser light source 2 is 

diffused by diffusion means 30 producing a recognizable pattern of light and dark (two 
diffusing circles and an opaque frame). Diffusion means 30 acts as diffusing irises and 
results in a plurality of objects. A detector 9 in the form of a CCD is positioned for 
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receiving light from the objects once the light is reflected off a reflective surface The 
detector 9 is provided with a frequency selective filter means 56 for filtering frequencies 
other than a predetermined range of frequencies. This allows use of the invention in 
lighted conditions. Alternatively, the filter means filters ambient light of predetermined 
frequencies. Further alternatively, no filter is used. Preferably, a diffused light source 
provdes illumination of a large percentage of a field of view for the detector. Preferably 
diffused light source thickness is small to result in shaip images at the detector 9. 

In operation, light emitted by the laser 2 is diffused by the diffi:sion means 30 
The diffused light reflects off the reflective surface 5 and reaches the detector 9 It will be 
clear to those skilled in the art that diffused light is likely to reach the detector 9 whereas 
colhmated light would be less likely to reach the detector 9 in sufficient quantities A 
range detection algorithm executed within a processing means 60. detem^ines a distance 
between the detector 9 and images 7 of the objects (diffusion means) 30. The processing 
means 60 then detennines a range between the detector 9 and the reflective surface 5 in 
dependence upon the known relative locations of the objects 30 and the detector 9 
Further, when sufficient images 7 are imaged by the detector 9 and in dependence upon a 
recognizable pattern of the objects 30, a surface shape of the reflective surface 9 is 
determined. 

In order to detemiine a range to an image at least two data points are required 
These pomts can be acquired by projectmg at least two light sources, by projecting an 
object with at least two discernible features, by capmring an image with at least two 
detectors or by capturing images with a detector provided with two irises (Biris). Each of 
these systems is discussed in detail below. 

Referring to Fig. 4, using a collimated light source and a diffuser, allows light 
wtthm a narrow band of frequencies to be projected and to form several objects 31-36 
Several objects result in several images 71-76 in reflection. Unfortunately, many detectors 
have small fields of view 10 of for example 30 degrees. 6 objects 3,-36 form 6 images 
71-76 m a mirror 5 but only objects 33. 34, 35, and 36 are detected by the detector 9 The 
.mages are al, visible to a human eye in a location chosen for a detector 9. Unfortunately 
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due to a field of view 10 associated with the detector 9, the images 71 and 72 are not 
detected by the detector 9. Since a range is calculated to each image and there is a known 
distance between each object and the detector 9, a determination of which image is 
associated with each object is possible. This determination is then used to accurately 
5 determine a distance to the reflective surface 5. 

To distinguish between associated objects and images, some calculations are 
performed. A distance is measured between the detector 9 and each image. Each 
distance corresponds to a series of potential locations and orientations of the reflective 
surface 5. The resulting equation for each distance Dj is a simple triangulation with an 
10 unknown angle at a vertex thereof. Thus, the distance Dj is equal to the distance of 4a 
added to the distance of 4b. The distances of 4a and 4b are interrelated by the distance 
from the object to the detector K (shown in Fig. 10). A discussion of the calculations 
required and the definitions of K, Kl,.. is presented later. 

Associating an image for which a distance is to be calculated with an object 
15 detennines a value for K. When the association is correct, a triangle is formed with a 
known base IC and an unknovm height Relying on the rules of geometry, a unique 
triangle has been defined. In dependence upon the orientation of the base and an angle 
defined by a vertex of the triangle, surface orientation is determined. Therefore, by 
determining a distance to an image and using the known distance from the detector to an 
20 associated object, a distance to an imaged point on a surface is determined. The 
orientation of the surface can be determined using two measurements. 

Unfortimately, as shovsm in Fig. 4, some images are not detected. When this 
occurs, images and objects must be associated correctly in order to determine an accurate 
measurement of distance. A method of associating images and objects is to project objects 
25 that arc distinguishable one from the other. Another method is to project objects spaced 
apart such that two objects associated incorrecdy with images will result in the 
determination of different surfaces; correlating determined surface location and 
orientation allows for verification of results. 
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Applying this latter method to imaging a reflective surface is now descnbed. An 
image is captured by the detector 9 (shown in Fig. 4) of a plurality of images. The number 
of images (4) is determined and a preliminary association is made. A distance to each 
image and a corresponding surface is determined. Each surface is then compared to 

5 determine whether or not the determined surfaces are consistent. Associating the images 
with different objects is performed in order to determine a consistency of other 
associations. Once sufficient associations have been made, a most consistent surface is 
selected as the surface measured. When the surface or the detector is moving, the 
consistency of the surface is measured against other surface shape and distance 

0 determinations. 

When the reflective surface S^has an irregular shape or is curved, further data 
points arc required to resolve surface geometry. A method of doing so is shown in Fig. 10 
and described later. 

Using a single diffused light source in the form of an LED, a single object exists. 

5 By capturing an image with each of at least two detectors, A distance to the image can be 
ascertained. Referring to Fig. 5, an embodiment of the present invention is shown 
opposite a flat reflective surface. A laser light source 2 is diffused by diffusion means 30 
producing a recognizable pattern of light and dark. The diffusion means 30 acts as an 
object. A plurality of detectors 9a and 9b iri the form of CCDs are positioned proximate 

0 the object. The detectors are provided with a frequency selective filter means 56 for 

filtering frequencies other than the laser frequency. Alternatively, the filter means filters 
ambient light at predetermined frequencies. Further alternatively, no filter is used. The 
use of two detectors results in the capture of two data points for the image (as is shown in 
Fig. 5) and allows for triangulation to be employed. 

5 Referring to Fig. 6, a system provided with 2 detectors and 2 diffused light 

sources is shown. The system results in the acquisition of 4 data points. Such a system is 
useful for range determination and for surface modeling of the reflective surface 5. For 
each image, a distance and surface orientation is calculated. Due to the increased number 
of data points, a solution is now possible (and unique) for surface distance, surface 
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orientation, and surface curvature (over a section of the surface). Moving the detectors or 
the surface allows image capture of the entire surface and allows for surface modeling. 
Preferably the relative motion is accurately measured to ensure accurate modeling. 

Referring to Fig. 7, £in embodiment wherein a single diffused light source projects 
5 images to each of 3 image capture means is shown. In principal, the device operates 
similarly to that of Fig. 6. Triangulation is achieved between each pair of points (three 
different pairs) to determine information relating to surface distance, surface geometry, 
and surface orientation. 

In Fig. 8, a similar system to that of Fig. 6 is shown wherein the light sources are 
10 diffused light sources in the form of LEDs 21. Alternatively, the light sources 21 can be 
regular diffused light sources (bulbs) or other diffused lighting means. The elimination of 
a laser light source reduces the overall cost of the system. When using limited frequency 
LEDs, a frequency dependent optical filter may be employed to filter out ambient light 
from light reaching the detector. 

1 5 Transparent surfaces tend to be reflective in part. In Fig. 9, a transparent surface 

50 in the form of a glass plate is shown. Using the present invention, both a surface 
geometry and a thickness can be determined for the glass plate. As is noted in dotted line 
at 4d, a further image is detected having a different distance (in this case plus twice the 
thickness of the glass plate). A processing means 60 resolves the images 7 and 7d and 

20 calculates image distances in order to determine plate thickness and surface geometry. 

Referring to Fig. 1 0, an embodiment of the present invention shovra opposite a 
reflective surface with regular curved geometry is shown. A laser light source 2 is 
diffused by diffusion means 30 producing a recognizable pattern of light and dark. The 
diffusion means 30 acts as a plurality of objects. Detectors 9a and 9b in the form of CCDs 
25 are positioned proximate the objects 30. Altematively, the detectors 9a and 9b are 

positioned in a location having a known spatial relation to a location of the objects 30. 
The detectors 9a and 9b are provided with a frequency selective filter means 56 for 
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filtering frequencies other than the laser frequency. Alternatively, the filter means filters 
ambient light of predetermined frequencies. Further alternatively, no filter is used. 

Returning to Fig. 9, In operation, light emitted by the laser 2 is diffused by the 
diffusion means 30. The diffused light is reflected from the reflective surface 5 and 
reaches the detectors 9a and 9b. It will be clear to those skilled in the art that diffused 
light will reach the detectors 9a and 9b whereas coUimated light would be less likely to 
reach the detectors 9a and 9b in sufficient quantities. A range detection algorithm 
executed witiiin a processing means 60, determines a distance between the detectors 9a 
and 9b and an image 7 of the objects (diffusion means) 30. Where, as in this instance, the 
reflective surface is non-linear, the image 7 is distorted relative to the objects 30 and/or 
magnified relative to the curvature of the surface. The processing means 60 correlates 
objects 30 and images 7. Alternatively, points on an object (known) are correlated with 
points on a captured image (reflected). Using the known spatial relation between the 
detectors 9a and 9b and the objects 30, the processing means determines a distance to at 
least some of the points on the reflective surface 5. Locations of these points are then used 
to determine a surface geometry for the reflective surface 5 and therefore orientation and 
magnification of the curved surface can be determined. At least 3 captured images are 
required to detemiine surface geometry. Preferably, more images are captured. Further 
images at different angles or from different known locations allow for the consmiction of 
a geometric model of the reflective surface 5. Alternatively, a large object with a 
discernible pattern is used to model the entire surface. Further alternatively, the diffused 
light source is stationary and only the detretors 9a and 9b move. In this last embodimem, 
the diffused light source's pattern is used to determine detector angle or location; image 
overlap is used to construct a model of the reflective surface 5. 

Referring to Fig. 1 1, calculations used in determining a distance to a detected 
image are shown. A detector is spaced a distance Kl from a first object and a distance K2 
from a second object. The objects are spaced apart by a distance of K and the two objects 
and the detector are co-linear. Therefore, K= | K2 - KI |. The detector detects images of 
each of the first and second objects. The images are at angles of a and G, respectively, 
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Between the images of the first and second objects is a distance K similar to that distance 
between the objects themselves. Therefore, a triangle is formed with a known base and a 
known angle opposite the base. This results in a determined triangle. Once determined the 
values of Dl and D2 are calculated using trigonometric functions or other known 
5 methods. 

A second series of triangles is now formed in which the bases are KI and K2 
respectively. Angles of a comer of each triangle adjacent the base are known. The 
distance around the perimeters of the two triangles are DI + Kl and D2 + K2, 
respectively. This is known because the optical paths from the detector to the images D 1 

10 and D2 are equal in length to the optical path from each of the first object and the second 
object, respectively. As the light travels in a substantially straight line from the object to 
the reflective surface and from the reflective surface to the detector, the distance Dl is 
equivalent to the distance in traversing two sides of a triangle; the third side of the triangle 
has a length Kl . Similarly, D2 is equivalent to the distance in traversing two sides of a 

15 triangle; the third side of the triangle has a length K2.With this information the two 

triangles can be evaluated to determine all distances and thereby measure a distance to a 
point on a substantially flat reflective surface. This method of determining range is known 
in the art as photogrammetry . • 

Referring to Fig. 12 an embodiment of the invention using a Biris detector 9 
20 having two apertures 91 and 92, a lens 96, and a CCD 97 and 4 diffusing light sources 3 is 
showoi. Existing implementations of Biris systems weight standard plane of light range 
measurement contributions with Biris contributions to increase accuracy of a range 
measurement. A plane of light measurement forms a large part of a range measurement 
since it relies on a large triangulation base. 

25 When surface curvature is small, because of a small separation between apertures 

91 and 92 in the detector 9 mask a range is calculated by the system. The distance 
between the apertures 91 and 92 is referred to as b. Further, an angle of incidence of light 
is determined in dependence upon a point on a CCD within the detector 9 where the light 
is incident. The point is referred to as p. From these two values (p and b) range can be 
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15 



20 



25 



determined (as explained with reference to Fig. 1 1 and U.S. Patent 5,270, Validation of 
Optical Ranging of a Target Surface in a Cluttered Environment to F. Blais). 

When curvature of a surface is monotonic, range measurements from 2 different 
profiles are used to evaluate the curvature of the surface. Alternatively, p is used as with 
> other curved surfaces. Once a curvature of a surface is known, a relation between b and p 
becomes known and is used to validate range measurements. 

One possible algorithm that includes signal validation and range refinement based 
on low curvature property of a reflective surface is as follows: 

1 . for each detected image, compute a range; 

2. to each image associate an object; 

3. for each image range and associated object, compute a surface range and 
orientation; 

4. evaluate the surface orientation/curvature and range resulting from each 
computation in step 3 and correlate them; 

5. when the computed values do not correlate, associate the images with different 
objects and return to step 3; and 

6. ^^hen the computed values correlate, minimize any range surface curvature 
errors computed in step 3. 

In measuring range for curved surfaces compensation for curvature of the surface 
.s applied. The compensation is used because curvature of a reflective surface alters image 
locations. When curvature is sufficiently small, the surface is treated as a planar surface 
for each measurement and a curved surface is reconstructed in dependence upon a 
plurality of range measurements. Alternatively, when the curvature of the surface is not 
sufiRciently small, compensation is required. 

For a lens of radius r and index of refraction n, the focal length is 
r=(n- 1 )f (for a mirror n= - 1 ). 
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The distance of the position of the image to the surface is modified by the 
curvature of the surface; however, the technique to compute the location of the reflective 
surface assumes a substantially flat surface (r=oo) and therefore, any change in image 
location results in a corresponding change to a measurement of range. In order to 
5 determine curvature for the surface using the above equations, we require its range. In 
^ order to determine the surface range using the above equations, we require a known 
surface curvature. Because both curvature and range are unknovm, an iterative approach 
to converge measured range and curvature to corresponding values. A detailed 
mathematical explanation of a method employed is presented in Appendix A attached. 

1 0 Using a system as defined in the present invention, effects of laser speckle are 

reduced. Smooth reflective surfaces are known to reduce laser speckle. Further, 
polychromatic light sources may be used, thereby avoiding laser speckle. 

Anamorphic lenses may increase camera accuracy while retaining field of view. It 
will be apparent to those of skill in the art that as laser field of view increases, further 
1 5 constraints are imposed upon dimensions of light sources arrays. 

For imaging reflective surfaces with a high degree of curvature, light source and 
detector location is important. As such, specific light source-detector geometries for high 
curvature surfaces are employed. This improves a chance that sufficient images will fall 
within a field of view of a detector, and that those images are correctly associated with 
20 objects. Distinguishing between objects can be achieved in many ways. For example, 
each object (diffused light source) can have a different wavelength or a different shape. 
Allowing sufficient images to fall within a field of view is a geometrical problem to be 
solved in dependence upon known criteria regarding a surface. 

Referring to Fig. 13, a method of determining distance and reflective surface 
25 geometry is shown in a flow diagram. Diffused light is projected at a reflective surface a 
range for which is to be determined. The diffused light is in the form of at least an object. 
The diffused light reflects off the reflective surface and is detected by at least a detector. 
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At least two and preferably at least three instances of reflected light are detected by the ar 
least a detector. 



a 

"a 



For each instance a range is calculated to an image (as viewed by the at least 
detector) of the at least an object. Each image is associated with an object in the form of 
diffused light source. The association is estimated and may be incorrect. In dependence 
upon each association, a range and orientation are calculated for the reflective surface. 
The calculated ranges and orientations for each image are compared to determine a 
surface. When a surface results, it is refined by reducing eirors in surface range and 
curvature. When an inadequate surface results, at least an image is associated with a 
different object and die range and orientation is recalculated. The method continues from 
the calculation of range and orientation as set out above. 

A diffused light source is a primary light source providing diffused light. 
Alternatively, a diffused light source is a secondary light source transmitting or reflecting 
light incident thereon in a diffused fashion. A discernible object reflecting some diffused 
light acts a diffused light source. Further, as described above, the primary source of light 
need not provide diffused light and, in an embodiment, is a collimated laser light source 
in conjunction with a diftiiser acting as a secondary light source. 

Numerous other embodiments of the invention may be envisioned without 
departing from the scope of the invention. 
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Appendix A 
Range measurement of reflectives surfaces 

- Compensation of surface radius: 2D case - 
This document evaluates the modifications that are needed to the range data to compensate for 
the radius of the object surfece. 

The cun/ature of the object changes the position of the image of the source. If the curvature is 
small, then the surface can be considered planar and a direct reflection of the image occurs. If not 
then the location of the image changes and must be compensated. 

This document is confidential and is the property of. 
Francois Blais 

National Research Council of Canada, Institute for Information Technology 
Ottawa. Ontario, K1A-0R6 

Dale By Commgnt 

8/20/1996 F.B. initial draft (rev il) 

8/21/1996 F.B. Initial draft (rev III) 

9/6/1996 F.B. Use tangential aberations 



For a lens or radius r and index of refraction n. the focal length is 

r«(n - 1 )• for a mirror (n=-1 ): — • 

2 

The distance of the position of the image of the source to the surface is modified by the "focal" of 
the surface, using the formula: 

— — .-L ^ _!_ rjobj is the position of the object 

f r_ls r_obj r rjs r_obj 

However the technique to compute the location of the surface of the reflective object assumes 
r=oo and therefore the change in the location of the image will affect the exact location of the 
surface. 

We need the exact location of the surface to compute its curvature, and vice-versa. The idea Is to 
iteratively converge to the exact surface location, each time computing a new surface curvature 
and position. 

From the range sensor the distance of the image to the camera ric is related to the distance of the 
camera to the surface using: 

rioroc ^ ro ci = camera image, co=camera object. oi=object image 

The actual method, assuming a flat surface (p=oo) computes the location roc. Assuming r<>ao 
(mirror) then 
ric imroc r roi 
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obteiiYie'd Csinl-^*"'^^ modified position of the image ric_r. The compensated position ric is 
--— ' 0 -L ' 

CO -rJs^_obj_ 'rjs'r^bir 'Js-r.obL 

therefore, 

feq r_obj_m r_obj 

Knowing the normal to the surface; 5. and the angle of the camera, with the position of the image 
If a mirror was used: yijm, zi_m "naye 

5«ataii} ~ y 

[(zs- zi^in) 



The equivalent focal length of the mirror is (using curvature c) c»- 

R 

feq-f^nominafcos<4» - 6) f.noininafc— f nominal— fcq«— cosC* - 6) 

2 - 2 c ^ 2 c 

Furthermore we have 

" cos(4i) 

therefore, using z measurements as reference: 

' « ' . ^ cos(<|>)-cos(<|) 5) zi) 

'•cos(<l> 6) ~ ( 2c.zit 2czo cos(4t) cos((l) 6)7" 

2 c \ cos(<|>) / cos(^) 



zi fn.z 

5-0 v-2'c zo zit 2 c'Zo'' - cos(<l)) ziy 



Given 

zi_m23-cos(^) 



V2-C-Zi r 2'C ZO - cos(<l>)^) 



zi_imzi_m2t- z z»izi2 r z 

2 2*2 I 2 1 

7~ rr • c 1- — 

V-2-czi2-cos(4.rj »-"»2 cos(4)^ ^ 



2i OT.i.-^'^'^?j!i:5:£'L-'_gQ'^^ ^)'gQs(<i) S)'zi ) 



1 ,1 I 

^ •cos((|» 6) '^'tJ?..?^ ^» 20 " { 2czir 2 c*zo ^ cos(i^) cos((|> 6)) 

2 c \ cos(<|») . cos((|>) 



16 

SUBSTITUTE SHEET (RULE 26) 



wo 98/21550 



PCT/CA97/00846 



2nd derivative of a surface vs curvature 

I'm trying to evaluate the relationship between the 2nd derivative and the curvature of a surface. 

This document is confidential and is the property of: 
Francois Blais 

National Research Council of Canada* Institute for information Technology 
Ottawa. Ontario. K1A-0R6 

Qatfi By Commgnt 

9/16/1996 F.B. Initial draft 



The generalized spherical surface is 



Example: 



c = curvature of the surface 
r - radial coordinate 
k s conic constant 

k < -1 : hyperbolas. k = -1 
parabolas 

-1 < k < 0 : ellipses. k = 0 : 

sphere 

k > 0 : oblate ellipsoids. 



zac~ 



sphere (k=0) 



parabola (k=-1) 



c»2- 



Note: f«" f»— - 
2 2'C 



4f 



Taking the derivatives: 



— ■ c- r V— ^ — J ^ ■ 

Ml • Ji 2 2 2 2 .) 2 2 2 2, 

/ 2 2 2 2 ' ~ - - 



d2z 4i - ji-c T - 3rc T -k - - I i- c T t- c -r -k-c t -k - 4%i - 1 r c -r r c -r 'k »- -vj - I t- c -r - c t -k'C t 



2 2 ^2 2, 



2 2 2 2 , 2 2! 



d2z 
hm — -c 

r-^ 0 dr^ 



2 2.\W! 



22 ''2 22 A* 

^ i -A^- 1 f c r * c"-r -ky I ^ c r r c -r -k/ , 
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For the sphere: k=0 
Substituting cmjcl 

(f 



c2« 



(Y- I) 



l( l.i-i-l .cV)'.(.l.cV) 

dr I >2 , ] 

liwi.J-I.cVjw-l.cV) 



d22 ^'l-y 



Y r 



dz yi -Y 



Substituting dr from the first derivative 

/ 2\ : 

From the first derivative: 
dr 



dr* 



d2z> 



V I - c r 



(dr^dz^) 



d2z*c 



1 - c"-r 



2 2 dr^ 



(dr^dz^) 



d2z 



;3\ 

\dr T dz i 



Rewritten in a more "useful!" format 
d2z 



— d2z 



dr" 



— -dz 
dr 



7V - 



dr" 



Vdr" ^ dz^) : 



I.e. 



d2zpd2z rdr 



dz«dz rd 



d2z r 



(l.dz^r^) 
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Claims 

What is claimed is: 

1. A method of measuring a distance from a first location to a reflective surface 
comprising the steps of: 

5 directing diffused light toward the reflective surface to form a first image therein; 

using a range imaging means having a detector to measure a distance from the detector to 
the first image formed by the diffused light; and 

determining the distance to the reflective surface based on a known relationship between 
the location of a diffused light source, the location of the detector and the distance fi-om 
10 the detector to the first image formed in the reflective surface. 

2. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the distance from the detector to the first image is determined in dependence upon 
detecting the first image with a plurality of detectors. 

3. A method of measuring a distance to a reflective surface as defined in claim 2 wherein 
15 the plurality of detectors is at least 3 detectors and, wherein the method further comprises 

the step of determining a surface geometry of the reflective surface. 

4. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the first image and at least another image are formed in the reflective surface, and, 
wherein the method further comprises the step of: 

20 detecting the at least another image with the detector; 

and wherein the distance fix)m the detector to die first image is determined in further 
dependence upon the detected at least another image. 
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5. A method of measuring a distance to a reflective surface as defined in 6laimM wherein 
the plurality of images is at least 3 images and wherein the method further comprises the 
step of determining a surface geometry of the reflective surface. 

6. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
5 the first image and at least another image are formed in the reflective surface, and, 

wherein the method fiirther comprises the step of: 

using a plurality of detectors having a known spatial relation therebetween to detect the at 
least another image; 

and wherein the distance from the detector to the first image is determined in further 
10 dependence upon the detected at least another image and the known spatial relation. 

7. A method of measuring a distance to a reflective surface as defined in claim 6 further 
comprising the step of determining a surfece geometry of the reflective surface. 

8. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the detector is a Biris detector. 



15 



9. A method of measuring a distance to a reflective surface as defined in claim I wherein 
the diffused light fomis a plurality of objects, the directed light reflected off^of the 
reflective surface forms a plurality of images, and the range is determined by the steps of: 

a) associating each image from the plurality of images wiA an object fi^m the pluralitv of 
objects; " • ' * — ^' - . 

20 b) using the processing means, for each image, determining a distance to an estimated 
reflective suri^ace in dependence upon the associated object location, the location of the 
detector, and said image location; 

0 comparing the estimated surface detemuned for each image with estimated surfaces 
detemimed for other images and evaluating the surfaces to see if a substantially same 
25 surface is determined; 
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d) when substantially a same surface is not determined, using a processor, associating 
each image with a different object from the piuraUty of objects and returning to step (b); 
and, 

e) when substantially a same surface is determined, using the processor means, correcting 
S the surface in dependence upon each determined surface. 

10. A method of measuring a distance to a reflective surface comprising the steps 
ofrprojecting toward the reflective surface, a pattern of diffused light forming an 
object;using an imaging mezms comprising a detector, said detector having a known 
spatial relation to the object, receiving some of the projected light reflected off of the 

10 reflective surface and fomiing an image of the object;using a processing means, 
determining a range to an image of the object; andusing the processing means, 
determining a distance to the reflective surface based on the known spatial relation and 
the image range. 

11. A method of measuring a distance to a reflective surface as defined in claim 10 further 
15 comprising the step ofidetermining, in dependence upon the range determined for the 

image and the known spatial relation, a surface geometry and range for the reflective 
surface. 

12. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the panem of diffused light forms a plurality of objects, the projected light 

20 reflected off of the reflective surface forms a plurality of images, and the range is 
deterinined by the steps of: 

a) associating each image from the plurality of images with an object firom the plurality of 
objects; 

b) using the processing means, for each image, determining a distance to an estimated 
25 reflective surface in dependence upon the known spatial relation and said image location; 
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c) comparing the estimated surfaces determined for eacli image and evaluating ihe 
surfaces to see if a same surface is determined; 

d) when substantially a same surface is not determined, using a processor, associating 
each image with a different object from the plurality of objects and returning to step (b); 

5 and 

e) when substantially a same surfece is determined, using the processor means, correcting 
the sur&ce in dependence upon each determined surface. 

13. A method of measuring a distance to a reflective surface as defined in claim 1 0 
wherein the pattern of diffused light is formed by projecting collimated light toward the 

1 0 reflective surface and diffusing the collimated light prior to the light reaching the 
reflective surface. 

14. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the projected pattern of diffused light comprises lines of varying lengths. 

15. A method of measuring a distance to a reflective surface as defined in claim 10 further 
1 5 comprising the step of filtering ambient light from light reaching the detector. 

1 6. A method of measuring a distance to a reflective surfece as defined in claim 1 0 
wherein the imaging means comprises a plurality of detectors. 

1 7. An imaging system comprising: 

a diffiised light source for directing diffused light toward a surface and for forming at 
20 least an image therein; 

an imaging means comprising at least a detector for receiving diffused light reflected from 
the surface and having a predetermined spatial relation with the diffused light source; and 

image processing means for determining a distance from the system to an image of the at 
least an image and for determining a distance from the system to at least a location on the 
25 surfece from which diffused light is reflected. 
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18. An imaging system as defmed in claim 17 wherein the diffused light source is for 
directing diffused light of substantially a same wavelength. 

19. An imaging system as defined in claim 17 wherein the diffused light source is for 
forming a predetermined pattern of light and dark. 

5 20. An imaging system as defined in claim 1 7 further comprising means for determining a 
surface geometry of the surface in dependence upon the distance. 

21. An imaging system as defined in claim 1 7 wherein the diffused light source comprises 
a coUimated light source and a diffusion means. 

22. An imaging system as defined in claim 17 wherein the diffused light source comprises 
10 an LED. 

23. An imaging system as defined in claim 17 wherein the diffused light source comprises 
a laser diode. 

24. An imaging system as defined in claim 17 further comprising a filter for filtering 
ambient light from light reaching the detector. 
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